Discrete Entropy Power Inequalities via Sperner Theory
نویسندگان
چکیده
A ranked poset is called strongly Sperner if the size of k-family cannot exceed the sum of k-largest Whitney numbers. In the sense of a function ordering, a function f is (weakly) majorized by g if the the sum of k-largest values in f cannot exceed the sum of k-largest values in g. Two definitions arise from different contexts, but they have strong similarities in their own meanings. Furthermore, the product of weighted posets has another similarity with the convolution of functions. Elements in the product of ranked and weighted posets capture structures of the building blocks in the convolution. Combining all together, we are able to derive various types of entropy inequalities and discuss their applications.
منابع مشابه
Information theoretic inequalities
The role of inequalities in information theory is reviewed and the relationship of these inequalities to inequalities in other branches of mathematics is developed. Index Terms -Information inequalities, entropy power, Fisher information, uncertainty principles. I. PREFACE:~NEQUALITIES ININFORMATIONTHEORY I NEQUALITIES in information theory have been driven by a desire to solve communication th...
متن کاملForward and Reverse Entropy Power Inequalities in Convex Geometry
The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent developments on forward and reverse entropy power inequalities not just for the Shannon-Boltzmann entropy but also more generally for Rényi entropy. In the proce...
متن کاملSeventh Workshop on Information Theoretic Methods in Science and Engineering
Shannon’s entropy power inequality characterizes the minimum differential entropy achievable by the sum of two independent random variables with fixed differential entropies. Since the pioneering work of Shannon, there has been a steady stream of results over the years, trying to understand the structure of Shannon’s entropy power inequality, as well as trying to develop similar entropy power i...
متن کاملEvaluation of monitoring network density using discrete entropy theory
The regional evaluation of monitoring stations for water resources can be of great importance due to its role in finding appropriate locations for stations, the maximum gathering of useful information and preventing the accumulation of unnecessary information and ultimately reducing the cost of data collection. Based on the theory of discrete entropy, this study analyzes the density of rain gag...
متن کاملInformation Theory and Decision Tree
3 Basics of information theory 3 3.1 Entropy and uncertainty . . . . . . . . . . . . . . . . . . . . . . . 4 3.2 Joint and conditional entropy . . . . . . . . . . . . . . . . . . . . 4 3.3 Mutual information and relative entropy . . . . . . . . . . . . . . 5 3.4 Some inequalities . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 3.5 Entropy of discrete distributions . . . . . . . . . . . ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1712.00913 شماره
صفحات -
تاریخ انتشار 2017